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DETAILED ACTION 

Action Background 

1. This action is responsive to the Request for Continued Examination filed on 
12/17/2008. 

2. Applicant has amended claims 1, 14 and 27. Claims 2-12, 16, 18, 22, 23 and 28- 
33 were previously canceled. 

3. Claims 1, 13-15, 17, 19-21, 24-27 and 34-42 are pending in the case; claims 1, 
14 and 27 are independent claims. 

4. A request for continued examination filed under 37 CFR 1.114, including the fee 
set forth in 37 CFR 1.17(e), was filed in this application after a final rejection. Since 
this application is eligible for continued examination under 37 CFR 1.114, and the 
fee set forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous 
Office Action (dated 9/8/2008) has been withdrawn pursuant to 37 CFR 1.114. 
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Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 
made. 

6. Claims 1, 13-15, 17, 19-21 , 24-27 and 34-42 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Hawkins al. US Patent 6,493,464, filed 9/8/1997, 
patented 12/10/2002 (hereinafter Hawkins) in view of Forcier, US Patent 6,499,043, 
filed 9/12/1996, patented 12/24/2002. 

7. Regarding independent claim 1, Hawkins discloses a computerized method of 
receiving user input identifying a symbol, a text expansion and a program, 
associating the text expansion or the program with the symbol, and determining 
whether the handwritten user input represents a symbol that is a short hand entry for 
a text expansion, a program or function. Hawkins recites: "the computer system 
could be programmed to allow a user to define new input strokes, and/or to 
associate symbols, characters, or even complete words or phrases, to a combination 
of input strokes. Thus, a user-maintained glossary could be built where the user 
could define the sequences of characters-or symbols, text, or program functions-to 
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be associated with a stroke, a multi-stroke combination, or sequence of multiple 
stroke combinations" (column 12, lines 2-11). 

Hawkins discloses determining a context in which the handwritten user input is 
written. Hawkins recites: "the user could also define new strokes within a table (or 
other data structure) and assign context to each such stroke" (column 12, lines 11- 
13). 

Hawkins discloses the symbol to be text expansion. As noted above, Hawkins 
discloses associating a user input stroke with a complete word. Hawkins discloses 
programs associated to a shorthand type. Hawkins recites: "a user-maintained 
glossary could be built where the user could define the sequences of characters-or 
symbols, text, or program functions-to be associated with a stroke, a multi-stroke 
combination, or sequence of multiple stroke combinations" (column 12, lines 6-11). 

Hawkins discloses displaying expanded text, implementing a function or 
launching a program dependent upon the symbol. Hawkins recites: "a user- 
maintained glossary could be built where the user could define the sequences of 
characters-or symbols, text, or program functions-to be associated with a stroke, a 
multi-stroke combination, or sequence of multiple stroke combinations" (column 12, 
lines 6-11). 

Hawkins discloses associating handwritten user input with a symbol, where the 
symbol is used as a function, and where the function is a text expansion or a 
program, as described above. Hawkins fails to disclose associating the user input 
with more than one function, and determining the function to use based upon the 
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context of the input within the user written input. Forcier discloses assigning 
handwritten user input to multiple functions, and determining the proper function to 
use based upon the context of the input within the user written input. 

Forcier discloses assigning a user input to functions. Forcier's user input is a two 
stroke gesture. Forcier recites: "Gestures are pen movements used to tell the 
processor control program to do something. This invention uses a two-part gesture. 
The first part initiates gesture control; the second part is the gesture itself. The 
processor allows the user to perform a pen action within the document to indicate 
that a control gesture is going to be made that should not be interpreted as an 
additional text/drawing stroke" (column 13, lines 36-42). Forcier discloses assigning 
the user input to multiple functions. Forcier recites: "A two-step gesture method 
avoids confusion between strokes and command gestures and allows use of similar 
gestures for different functions within the same and different contexts" (abstract). 
Forcier discloses a determining step where the context is considered to determine 
the correct function. Forcier recites: "The gesture set is also context-sensitive as 
between text and graphical editing, depending on whether the stylus is in a lined 
writing area or an open (unlined) drawing area of the document. Furthermore, 
different initial pen actions can be used to obtain different gesture mode prompts. In 
each case, subsequent gestures initiate different functions, depending on 
location/context and form of gesture prompt' (column 4, lines 61-67). 

Therefore, it would have been obvious, to one of ordinary skill in the art at the 
time the invention was made to combine associating handwritten user input with a 
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symbol, where the symbol is used as a function, and where the function is a text 
expansion or a program, as taught by Hawkins, with the context sensitive user input, 
as taught by Forcier, in order to provide "an interactive method for entry and editing 
of script, text and drawings in a document display" (Forcier, column 1 , lines 1 6-1 7). 

8. Regarding dependent claim 13, the claim is directed toward a computer- 
readable medium for the method of claim 1, and is rejected using the same 
rationale. 

9. Regarding independent claim 14, Hawkins and Forcier disclose the input as 
handwritten input as described above. Hawkins and Forcier disclose the handwritten 
user input includes a first and second handwritten input (described as a two stroke 
gesture), where the choosing depends upon the first handwritten user input includes 
the second handwritten user input, as described above. See also the "Gesture 
Based Editing section of Forcier, starting at column 13, line 30 for a complete 
description of the dependence of the first and second handwritten user strokes. The 
balance of claim 14 is substantially the same as claim 1, and is rejected using the 
same rationale. 

10. Regarding dependent claim 15, Hawkins discloses the first handwritten user 
input as a single word. Hawkins recites: "the computer system could be programmed 
to allow a user to define new input strokes, and/or to associate symbols, characters, 
or even complete words or phrases, to a combination of input strokes" (column 12, 
lines 3-6). 
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11. Regarding dependent claim 17, Forcier discloses the user handwritten input 
being compared to a predetermined set of symbols, which are used in the 
determining step. Forcier recites: "Another aspect of the invention is a method that 
enables the user to use a single gesture set to manipulate both script and ASCII 
text, and even drawings, all within a single document' (column 4, lines 34-37). 

12. Regarding dependent claim 19, Forcier discloses the second handwritten input 
as any handwritten user input other than the first handwritten user input that is 
simultaneously displayed with the first handwritten input. As described above, 
Forcier discloses a two stroke gesture, where the first stroke is different than the 
second stroke, and the first stroke and the second stroke are simultaneously 
displayed. 

13. Regarding dependent claim 20, Forcier discloses the first and second 
handwritten user inputs on the same line in Figure 7B, shown as the "INSERT 
SPACE GESTURE'. 

14. Regarding dependent claims 21 and 37-39, Hawkins discloses receiving 
handwritten user input, a first and second determining step, and applying an 
extension. Hawkins fails to disclose determining whether a total handwritten user 
input word count is equal to one, and if so then determining that the first handwritten 
user input is not associated with any other handwritten user input. However, 
Hawkins teaches the determining of associations of first and second user inputs as 
described above. Hawkins further teaches various user inputs that would allow a 
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determination to be made as to whether the word count was equal to one. For 
instance, Hawkins' Figure 5A shows typical end of word indicators, including "space" 
and "CRLF" symbols that would indicate that a complete word had been entered. 
Therefore, it would have been obvious, to one of ordinary skill in the art, at the time 
the invention was made, to use a non-printing character symbol to indicate the user 
had entered a complete word in order to allow the system to be used for word 
processing functions. 

15. Regarding dependent claims 24 and 25, Hawkins discloses determining the 
user input in response to the user input having stopped, or waiting a fixed period of 
time. Hawkins recites: "In the past, recognition systems have solved this ambiguity 
by waiting until the user stopped writing, or by having a fixed delay period, after 
which characters were recognized' (column 3, lines 17-20). 

16. Regarding dependent claim 26, the claim is directed toward a computer- 
readable medium for the method of claim 14, and is rejected using the same 
rationale. 

17. Regarding independent claim 27, the claim is substantially the same as claim 
1 , and is rejected using the same rationale. 

18. Regarding dependent claim 34, the claim is directed toward a computer- 
readable medium for the method of claim 27, and is rejected using the same 
rationale. 
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19. Regarding dependent claims 35 and 36, Hawkins discloses receiving user 
input identifying the text expansion and the program prior to receiving the first user 
handwritten input, as described above. 

20. Regarding independent claims 40-42, as described above Hawkins describes 
user created symbols and symbol combinations where the number of symbols and 
their sequence dictate the association between the symbols and the representation. 
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Response to Arguments 

21. Applicant's arguments filed 12/17/2008 have been fully considered but they are 
not persuasive. 

22. Regarding independent claims 1 and 27, applicant argues that Figure 9 of 
Hawkins fails to disclose text expansion (page 8, second paragraph, of the response 
filed 12/17/2008). Applicant is directed to the rejection of the claims, as stated 
above. The examiner agrees that Figure 9 of Hawkins does not disclose text 
expansion. However, Hawkins discloses text expansion. As noted above, Hawkins 
discloses: "the computer system could be programmed to allow a user to define new 
input strokes, and/or to associate symbols, characters, or even complete words or 
phrases, to a combination of input strokes. Thus, a user-maintained glossary could 
be built where the user could define the sequences of characters-or symbols, text, 
or program functions-to be associated with a stroke, a multi-stroke combination, or 
sequence of multiple stroke combinations" (column 12, lines 2-11). Hawkins 
discloses text expansion i.e. associating a user input stroke with a complete word. 

23. Applicant also argues that Forcier's multi-part user input includes context 
information (page 8, last paragraph, to page 9, third paragraph, of the response filed 
12/17/2008). Applicant is directed to the rejection of the claims, as stated above. The 
examiner would point out that the invention described by Forcier is a pen-based 
processing system (see abstract), and therefore all input by a user is going to be 
made with the pen and is therefore handwritten input. The examiner considers a 
gesture made by hand with the pen as 'handwritten user input" 
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Conclusion 

24. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gregory J. Vaughn whose telephone number is (571) 
272-4131 . The examiner can normally be reached Monday to Friday from 8:00 am to 
5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen S. Hong can be reached at (571) 272-4124. The fax phone 
number for the organization where this application or proceeding is assigned is (571 ) 
272-2100. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR 
only. For more information about the PAIR system, see http://pair-direct.uspto.gov. 
Should you have questions on access to the Private PAIR system, contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

/Stephen S. Hong/ 

Supervisory Patent Examiner, Art 

Unit 2178 

/Gregory J. Vaughn/ 
Patent Examiner 
March 15, 2009 



